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Abstract 

We analyze a MIMO DS-CDMA channel with a general multiuser detector including a nonlinear 
multiuser detector, using the replica method. In the many-user, limit the MIMO DS-CDMA channel 
with the multiuser detector is decoupled into a bank of single-user SIMO Gaussian channels if a spatial 
spreading scheme is employed. On the other hand, it is decoupled into a bank of single-user MIMO 
Gaussian channels if a spatial spreading scheme is not employed. The spectral efficiency of the MIMO 
DS-CDMA channel with the spatial spreading scheme is comparable with that of the MIMO DS-CDMA 
channel using an optimal space-time block code without the spatial spreading scheme. In the case of 
the QPSK data modulation scheme the spectral efficiency of the MIMO DS-CDMA channel with the 
MMSE detector shows waterfall behavior and is very close to the corresponding sum capacity when 
the system load is just below the transition point of the waterfall behavior. Our result implies that the 
performance of a multiuser detector taking the data modulation scheme into consideration can be far 
superior to that of linear multiuser detectors. 

Index Terms 

Multiple-input multiple-output (MIMO) systems, direct-sequence code-division multiple access (DS- 
CDMA), asymptotic analysis, multiuser detection, replica method. 
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I. Introduction 

Future wireless communications will utilize frequency multiplexing and spatial multiplexing 
to realize ultra high speed data communications [1]. Joint maximum likelihood (ML) decoding 
with high complexity is required to mitigate multiple access interference and attain the greatest 
possible frequency and spatial multiplexing gains. On the other hand, an affordable receiver 
structure with lower complexity is desired practically. 

The key strategy to circumvent the complexity issue is to reduce a high-dimensional system to 
some lower-dimensional systems by making use of orthogonality. Strict orthogonality is utilized 
in Multicarrier (MC) schemes [l]-[3], orthogonal space-time block codes [4], and frequency- 
division multiple access (FDMA). Although the strict orthogonality reduces the complexity, it 
can degrade the performance, as it is known [5] that FDMA is inferior to code-division multiple 
access (CDMA). A better trade-off between complexity and performance is provided by adopting 
statistical orthogonality. The direct-sequence CDMA (DS-CDMA) scheme, which is mathe- 
matically equivalent to multiple-input multiple-output (MIMO) systems with the Vertical Bell 
Labs Layered Space-Time (V-BLAST) architecture, decomposes joint decoding into multiuser 
detection and single-user decoding approximately, using the statistical orthogonality of spreading 
sequences. Although it has been reported in [6] that information loss due to spreading is negligible 
in a highly loaded system, there exists a large gap between the spectral efficiency of a DS-CDMA 
channel with a conventional linear multiuser detector front end [7] and the corresponding sum 
capacity [6]. The gap can be closed by nonlinear multiuser detection. The result in [8] implies that 
an optimal nonlinear multiuser detector has the capability of achieving very close performance to 
the corresponding sum capacity. An asymptotically optimal polynomial-time iterative detection 
algorithm on the basis of message passing has been proposed in [10]. Furthermore, Guo et al. 
[9] discovered the decoupling structure of the DS-CDMA channel under a general condition, 
due to the statistical orthogonality. An interesting observation is that the algorithm of [10] has 
the same decoupling structure as that of the optimal multiuser detector [11]. 

Recently, MIMO DS-CDMA systems, which are the application of MIMO technology to the 
DS-CDMA scheme, are being considered in anticipation of application to future wireless commu- 
nications [12]— [15]. However, analysis of MIMO DS-CDMA systems is far from sufficient since 
many studies on MIMO DS-CDMA systems focus on conventional linear multiuser detectors 
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[12], [14], [15], and it remains unclear how statistical orthogonality provided by both MIMO 
and DS-CDMA decomposes the MIMO DS-CDMA systems. Elucidation of the performance 
and structure of MIMO DS-CDMA systems with nonlinear multiuser detectors will help reveal 
the potential of MIMO DS-CDMA systems, and construct an algorithm of nonlinear multiuser 
detection. We thus perform an information-theoretical analysis of MIMO DS-CDMA systems 
under a general condition, including nonlinear multiuser detections. 

The present paper is organized as follows. A MIMO DS-CDMA system model in a flat fading 
channel is introduced in Section [III Our main results are summarized in Section [III] and the 
numerical evaluations are described in Section [IV] We discuss nonlinear multiuser detection and 
the extension of the results in Section |V] Section |VT] presents our conclusions. 

Throughout the present paper, A T and A H denote the transpose of A and the conjugate 
transpose of A, respectively. £/V(0, S) stands for the circularly symmetric zero-mean complex 
Gaussian distribution with the covariance matrix S. represents the iV-dimensional vector of 
which the elements are all one. p(y\x, {Aj}; ©) denotes the probability density function of y 
conditioned on x and {Aj} with the parameter ©. log a and In a stand for log 2 a and log e a, 
respectively. KL(-||-) represents the Kullback-Leibler divergence with the logarithm to base 2. 
|^4|, (g>, Re(a), and Im(a) denotes the number of elements of a set A, the Kronecker product 
operator between two matrices, the real and imaginary parts of a complex number a, respectively. 

II. Model 

A. MIMO DS-CDMA Channel 

We consider an uplink of a chip-synchronous MIMO DS-CDMA channel with K users [12]. 
The kth user and the receiver have M k transmit antennas and N receive antennas, respectively. 
A space-time encoder for the kth user maps its message into a codeword matrix, each element 
of which is mapped into a symbol by a data modulator. The product of each symbol x k m , the 
variance of which is (received power), and a random spreading sequence {s k m \ I — 1, . . . , L} 
with the spreading factor L is then transmitted from the mth transmit antenna of the A;th user. 
The iV-dimensional received signal vector y l propagated through a flat fading channel is given 

by 

yi = Y,H k S k lX k + n h l = l,...,L, (1) 

k=l 
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where x k = (x k , . . . , x k Mk ) T is the symbol vector for the kth user; the M k x M k diagonal matrix 
S\ is given by S k = diag(sf 1 , . . . , sf M J; H = (h*,..., h k Mk ) is the N x M k random channel 
matrix for the kth user, i.e., the (n, m)-element h k m of H k represents the complex channel 
gain from the m k th transmit antenna of the kth user to the nth receive antenna; and rii ~ 
£A/"(0, N I N ) is additive white Gaussian noise (AWGN). The MIMO DS-CDMA channel ® 
can be expressed as the vector channel of higher dimension, 

y = Ax + ft, (2) 

where x = (x lT , . . . , x rT ) t is the entire symbol vector; y = (y 1 T ', . . . , y L T ) T represents the 
entire received signal vector in a symbol period; n = (rii T , . . . , n^ T ) T is the entire noise vector; 
and the matrix A is given by 

A = 

We consider a space-time spreading (STS) scheme, which is implemented with independent 
spreading sequences from antenna to antenna (Fig. [D, and a time spreading (TS) scheme, which 
uses the same spreading sequences for different antennas of each user (Fig. |2]>. 

Assumption 1: The real part and the imaginary part of {(%, . . . , s lM ,) T ;ke K = {1,...,K}, 
I — 1, . . . , L] are independent and identically distributed (i.i.d.) zero-mean random vectors with 
the covariance matrix [8eM k ^M k + (1 — 5) JAf fc ]/(2L). 

Letting 5 = and 1 in Assumption \T\ correspond to the STS and TS schemes, respectively. 
We further assume that the users are divided into P groups, in each of which the users employ 
the same number of transmit antennas and the same data modulation scheme. 

Assumption 2: For a partition {IC p ;p = 1,...,P} of /C, {x k ; k G IC P } are i.i.d. complex 
random vectors, and the symbol vectors of users who belong to different groups are mutually 
independent. 

Assumption 3: The moment generating function of x k m exists in the neighborhood of the origin. 

We remark that Assumption [2] includes the case in which the number of the groups is equal 
to the number of users and that Assumption [3] holds in the case of the Gaussian data modulation 
as well as any conventional digital data modulations. Although we need these assumptions in 
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order to derive part of results described in the next Section, we believe that Assumption [2] can 
be relaxed. 



B. Receiver Structure 

Assuming the channel side information (CSI) only at the receiver, we consider separate 
decoding, where a multiuser detector front end feeds soft or hard decisions to single-user space- 
time decoders. The multiuser detector postulates that the prior distribution of the symbol vector 
for the kth user is p(x k ), the moment generating function of which is assumed to exist in the 
neighborhood of the origin, and that the variance of the noise is N . Tildes indicate that the 
postulated prior distribution and the postulated variance of the noise need not coincide with the 
actual ones. The multiuser detector estimates the symbol vector of each user on the basis of the 
generalized posterior mean estimator (GPME) [9] 
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where x 
receiver: 



z,l\T 



((s 1 ) 



x ) T ) T and p(y\x, A, N ) represents the channel postulated by the 



y = Ax + h, h ~ CA/"(0, NqInl) ■ (5) 

The multiuser detector dU) corresponds to the minimum mean-squared error (MMSE) detector if 
p(x k ) and N coincide with p(x k ) and N . The multiuser detector becomes a linear detector if 
x k follows a zero-mean circularly symmetric complex Gaussian distribution. Furthermore, the 
linear detector corresponds to the linear MMSE detector if N coincides with N . 

The maximum spectral efficiency^ per chip of the MIMO DS-CDMA channel with CSI at the 
receiver is given by the mutual information between x and y [16] 



joint 



log 



(6) 



E s [p(y\x, A; N )] 

On the other hand, the spectral efficiency per chip of the MIMO DS-CDMA channel with the 
GPME detector front end is given by 

p({x k )\x k ,A, 



a 



sep 



1 K 1 K 

L k=i L k=i 



log 



E xk \p((x k )\x k ,A, 



(7) 



'Note that in the present paper the term "maximum spectral efficiency" refers to the spectral efficiency of a channel with an 
optimal receiver structure on condition that a data modulation scheme and power allocation are specified. 
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III. Main Results 

The main results comprise analytical formulas for Cj oint (Proposition [B and C scp (Proposi- 
tion |3]), and decoupling results (Proposition [2]) . First, we list some definitions. 

Definition 1: A single-input multiple-output (SIMO) Gaussian channel for the mth transmit 
antenna of the A;th user, a postulated SIMO Gaussian channel for the mth transmit antenna of the 
A;th user, a MIMO Gaussian channel for the kth user, and a postulated MIMO Gaussian channel 
for the kth user are respectively defined as 

CAf(0,R), (8a) 
CJ\f(0,R), (8b) 
:AT(0,W), (8c) 
W(0,W), (8d) 

where R, R, W, and W are N x N positive definite Hermitian matrices. 

Definition 2: The GPME of x k m in the SIMO Gaussian channel © and the GPME of x k in 
the MIMO Gaussian channel (l8~cl) are respectively given by 
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Definition 3: The maximum spectral efficiencies of the SIMO Gaussian channel (|8al) and the 
MIMO Gaussian channel (f8~cl) are respectively given by 
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Definition 4: The mean-squared error of the GPME (|9a|) , the generalized posterior variance 
of the SIMO Gaussian channel (f8ab . the error covariance matrix of the GPME (l9b~l) , and the 
generalized posterior covariance matrix of the MIMO Gaussian channel (|8c1 ) are respectively 
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defined as 
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In order to evaluate the maximum spectral efficiency © analytically, we consider the many- 
user limit in which both the number of users K and the spreading factor L tend toward infinity 
with their ratio (5 = K/L fixed, assuming the following: 

Assumption 4: The spectral efficiencies © and © satisfy the self-averaging property with 
respect to «S, i.e., © and © converge in probability respectively to the expectations of © and 
© with respect to S = {Sf ; I — 1, . . . , L, k 6 K,} in the many-user limit. 

The many-user limit has been considered in many previous studies [6]-[9], [12], [15], [17], 
[18]. The self-averaging property of the MIMO DS-CDMA channel has partially been proved 
under the assumption of the Gaussian data modulation, i.e., the self-averaging property of © 
has been proved for the STS scheme [12], [17], and has been proved for the TS scheme for the 
case of N = 1 or — > oo [12]. Since proving the self-averaging property for an arbitrary prior 
distribution of the symbol vector is a challenging problem, in this paper, as in previous studies 
[8], [9], the self-averaging property is assumed . 

Proposition 1: For arbitrary realizations of S and H = {H k ; k £ /C}, in the many-user limit 
the maximum spectral efficiencies © of the MIMO DS-CDMA channels with the STS and TS 



schemes are respectively given by 
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where R is a solution of the fixed-point equation 

i K M k 

R = N I N + (3hm E^: 
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and W satisfies the fixed-point equation 
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In the case in which there exist multiple solutions of R and W, one should choose the solutions 
so as to minimize the maximum spectral efficiencies (I12al) and (I12bl) . respectively. 

The derivation of Proposition \T\ is summarized in Appendix [AJ The operational meaning of 
the expressions (|12a| ) and (|12b|) is that the first terms in the right-hand sides are the spectral 
efficiencies of the MIMO DS-CDMA channel with the MMSE detector front end in the cases of 
the STS scheme and the TS scheme, respectively, and the second terms in the right-hand sides 
are the separation loss, i.e., the information loss due to the separation of detection and decoding. 
The following lemma is needed in order to derive the propositions providing this interpretation. 



Lemma 1: If {H ; k G JC P } are i.i.d., in the limit |/Ci| — > oo, . . . , \Kp\ — > oo, and L — > oo 
with their ratios {(3 P = \JC p \/L;p = 1, . . . , P} fixed, an arbitrary joint moment of the symbol 
vector and the GPME © for a user k E JC P converges to the corresponding joint moment of the 
symbol vector and its GPME in a single-user channel, i.e., 
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for STS, (15a) 
forTS, (15b) 
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In the case in which there exist multiple solutions of (R, R) and (W, W), one should 
respectively choose the solutions that minimize the free energies 



In 2 
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(19a) 
(19b) 



and the function F(-,~) is defined as 

F(A, A) = KL (CAf{0, N I N ) \\CAf{0, A) ) + KL (CjV(0, A) \\CAf{0, A 
+KL (CA/"(0, N I N ) \\CAT(0, A)) - KL (CAf(0, N I N ) \\CAf(0, AA~ l A) 



(20) 



Lemma Q] is derived in Appendix El From Assumption [3l the moment generating functions of 
the GPMEs (l9a|) and (l9bl) are expected to exist in the neighborhood of the origin, respectively. 
Then, the joint moment sequences (|15al) and (|15bl) uniquely determine the respective joint distri- 
butions. Furthermore, assuming that all joint moments of the symbol vector and the GPME © 
have the self-averaging property with respect to S, we obtain the following decoupling result. 

Proposition 2: If {x^, x 1 ^; m — 1, . . . , M^} are mutually independent and {H k ; k e IC P } are 



i.i.d., in the limit |/Ci| — >■ oo, 



l/C, 



» oo, and L — > oo with {/3 P } fixed, then the conditional 
joint distribution of a; fc and (a? fc ) conditioned on «S and 7i converges to the joint distribution of 
x k and its GPME in a single-user channel, i.e., 
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(21a) 
(21b) 



P (x k ,(x k )\s,n 

p(x k , (x k ) MlMO 
with (R, R) and (W, W) defined in Lemma [TJ 

Although in order to simplify the derivation of Proposition [2l we have assumed that the 
symbol vectors and the channel matrices are i.i.d. in the same group JC P , we conjecture that this 
assumption is not required. Proposition [2] implies that the decoupling principle [9] holds in the 
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MIMO DS-CDMA channel, i.e., in the case of the STS scheme the MIMO DS-CDMA channel 
(OQ) with the GPME detector front end ©) is decoupled into a bank of the SIMO Gaussian 
channels (|8al) with the GPME detector front ends (|9aT ) in the many-user limit, and in the case 
of the TS scheme the MIMO DS-CDMA channel ® with the GPME detector front end © 
is decoupled into a bank of the MIMO Gaussian channels (f8cl) with the GPME detector front 
ends (l9b~l) in the many-user limit. From this decoupling result we can evaluate the spectral 
efficiency © of the MIMO DS-CDMA channel © with the GPME detector front end ©. 

Proposition 3: If {x k ml x k m \m = 1, ...,M k } are mutually independent and {H h ;k G /C p } 
are i.i.d., the asymptotic spectral efficiency of the MIMO DS-CDMA channel with the GPME 
detector front end is given by 



1 



K M k 



C = P j im 77 E E <&>,gpme(«. k ) for STS ' < 22a > 

k=l m=l 

CH = (3 Jim 1 £) C^ IMOiGPME ( W) for TS, (22b) 

where C^mo. gpme(-^)-R) an d C MIMO gpme(^i W") ^ m e spectral efficiency of the SIMO 
Gaussian channel (l8al) with the GPME detector front end (f9ab and the spectral efficiency of the 
MIMO Gaussian channel (|8cl) with the GPME detector front end (l9b~l) , respectively. (iZ, H) and 
( W, W") are identical to those in Lemma [TJ 

Cf e p S and coincide with the first terms of (|12al) and (|12bl) . respectively, if p(a; fc ) = p(x k ) 
and A" = iV , i.e., the first terms represent the spectral efficiencies of the MIMO DS-CDMA 
channel with the MMSE detector front end in the respective cases. 

Although we have used the replica method to derive the results presented so far, the following 
Corollary demonstrates that Proposition [3] is reduced to the known results with the Gaussian 
data modulation [12], [17], which have been proved rigorously with random matrix theory. 

Corollary 1: If {x k m , x k m , m = 1, . . . , M k = M} follow i.i.d. CAf(0, P) and if {H k - k e K} 
are i.i.d. random matrices with i.i.d. entries, then the spectral efficiency of the MIMO DS-CDMA 
channel with the LMMSE detector front end is given by 

P\\h k l|2 ^ 



^LMMSE — (3ME 



log 1 + 



m l 



^LMMSE _ /^E 



k\H 



for STS, (23a) 
for TS, (23b) 
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where N R is the unique solution of the fixed-point equation 

N R 



n + §e 



PWh 

r 1 1 m I 



l + P\\hr. 



/N 



and N w is the unique solution of the fixed-point equation 



N w = N + mm(N, M)E 



R 



PX 



(24) 



(25) 



1 + PX/N W _ 

with A being the random variable following the marginal distribution of the unordered singular 
values of H k [19]. 

The above result for the STS scheme is consistent with that reported in [12], [17]. On the 
other hand, the result for the TS scheme includes and extends the result in [12], the latter of 
which has been proved only when the number of receive antennas is one or when the number 
of transmit antennas is infinite. 



IV. Numerical Results 

We compare numerically the spectral efficiency of the MIMO DS-CDMA channel in the case 
of several transmitter and receiver structures. In this section, we assume that the number of 
transmit antennas is uniform, i.e., M k = M, that {x 1 ^} are i.i.d. random variables with variance 
P, and {h* m } ~ i.i.d. £/V(0, l/N). From these assumptions, the spectral efficiencies (|12al) . (I12bl) . 
(122al) . and (|22bl) converge almost surely to their expectations with respect to 7i. Figure [3] shows 
the spectral efficiency of the MEMO DS-CDMA channel with the STS scheme and that with 
the TS scheme, in the case of the Gaussian data modulation. The maximum spectral efficiency 
of the MIMO DS-CDMA channel with the STS scheme is slightly larger than that with the TS 
scheme even if optimal space-time encoding is employed. This result implies that the TS scheme 
is suboptimal. On the other hand, the spectral efficiency of the MIMO DS-CDMA channel with 
the MMSE detector front end is slightly larger in the case of the TS scheme than in the case of 
the STS scheme when the system load (3 is high. 

We next consider the spectral efficiency of the MIMO DS-CDMA channel in the case in 
which the data modulation scheme is specified. Figure |4] shows the spectral efficiency of the 
MIMO DS-CDMA channel with the QPSK data modulation scheme in the case of the STS 
scheme. The spectral efficiency of the MIMO DS-CDMA channel with the MMSE detector 
front end displays waterfall behavior in the case of multiple antennas. The spectral efficiency 



February 1, 2008 



DRAFT 



12 

is much larger than the spectral efficiency of the MIMO DS-CDMA channel with the LMMSE 
detector when the system load j3 is smaller than the transition point of the waterfall behavior. 
Furthermore, the spectral efficiency is comparable to the maximum spectral efficiency of the 
MIMO DS-CDMA channel, which is very close to the sum capacity when the system load is 
just below the transition point. However, it decreases rapidly as the system load (3 becomes 
larger than the transition point. 

V. Discussion 

The results in Section [IV] imply that the separation loss can be reduced dramatically by 
employing a non-Gaussian data modulation scheme, even though it has less information per 
received power than the Gaussian data modulation, and taking the data modulation scheme into 
consideration in multiuser detection. Although it is difficult to perform the multiuser detection 
exactly, approximate methods of multiuser detection, e.g., an algorithm on the basis of message 
passing, may provide higher performance than linear multiuser detectors. 

One can obtain, from Propositions [2] and |3l hints about an appropriate structure of the 
transmitter and a method of constructing multiuser detection algorithms in many-user systems. 
In the case of the STS scheme, the spectral efficiency of the MIMO DS-CDMA channel with 
the MMSE detector front end is achieved by per-antenna encoding because (I22al) is given by the 
sum of the spectral efficiencies of the SIMO Gaussian channel (|8al) with the MMSE detector 
front end. This means that space-time encoding is not required, and furthermore, that the ergodic 
spectral efficiency E[Cf C p S ] does not decrease even if the transmit spatial correlation at each user 
exists. Another suggestion is that one should take a space-time encoded symbol vector x k as a 
single node in a message passing algorithm for the TS scheme, in order to acquire comparable 
spectral efficiency to that in the case of the STS scheme, although one can take the element x k m 
of the symbol vector as a single node for the STS scheme. 

Although we have so far considered the uplink of the MIMO DS-CDMA channel, our results 
can straightforwardly be extended to the cases of an uplink of a frequency-selective MIMO 
channel with the MC CDMA scheme (MIMO MC-CDMA) [13] and downlinks of these channels. 

Our model corresponds to the uplink of the MIMO MC-CDMA channel when H k is replaced 
by H k , which represents the channel matrix of the /th subcarrier from the kth user to the 
receiver. Furthermore, © coincides with the maximum spectral efficiency per chip and per sub- 
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carrier of the MIMO MC-CDMA channel without encoding across the subcarriers if the loss 

of spectral efficiency due to inserting a cyclic prefix is neglected. If {H k ;l = 1 ,L} are 

i.i.d., Propositions [TH31 in which H k is replaced by H k , hold for the case in which the ergodic 
spectral efficiency is considered. On the other hand, our model corresponds to the downlinks 
of the MIMO DS-CDMA channel and the MIMO MC-CDMA channel if {H k ; k = 1, . . . , K} 
and {iff ; k = 1, . . . , K}, respectively, represent the same fading [18]. In addition, in this case, 
Propositions [TJ-[3] hold without modification. It is easy to extend these results to the case with 
encoding across the subcarriers. 

VI. Conclusion 

We have analyzed the MIMO DS-CDMA channel with the GPME detector front end. In the 
many-user limit, the MIMO DS-CDMA channel with the MMSE detector front end and the STS 
scheme is decoupled into a bank of the single-user SIMO Gaussian channels with the MMSE 
detector front ends. On the other hand, the MIMO DS-CDMA channel with the MMSE detector 
front end and the TS scheme is decoupled into a bank of the single-user MIMO Gaussian channels 
with the MMSE detector front end. If suitable space-time encoding is employed, the spectral 
efficiency of the MIMO DS-CDMA channel with the TS scheme is comparable with the spectral 
efficiency of the MIMO DS-CDMA channel with the STS scheme, where space-time encoding is 
not required. Our results suggest huge potentialities of nonlinear multiuser detection, which can 
exceed linear multiuser detection, and a guideline for methods of constructing message passing 
algorithms for multiuser detection in many-user systems. 

Appendix A 
Derivation of Proposition CD 

We define the free energy T as 

F=- lim ^E{\nE,\p$ = y\Z,S,H ] N )] U\ , (26) 

where the limit in (|26l) stands for the many-user limit. From Assumption H in the many-user 
limit, the maximum spectral efficiency © is given by 

K l Boc C i° iat = LT2 • F U*)= P (-),JVo=^Vo - ^log(vrVoe). (27) 
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We evaluate the free energy (|26l) using the replica trick. Applying to (1261 ) the identity 





E[ln Z] = lim — In E\Z U ] for Z > a.s., 



we have 







T = — lim — — lim 

u— >0 K,L^oo K 



1 InSM, 



S<«> = E [ {E, [p(g = 5, W; iV )] }" 



(28) 

(29a) 
(29b) 



where we have exchanged the order of the many-user limit and the operations with respect to u. 
We evaluate (|29b| ) on {u = 0, 1, . . .} in the many-user limit, whose domain is extended to the 
real number field in the neighborhood of u = 0. The validity of these procedures is pending. 

We write the original symbol vector for the A;th user and the i.i.d. replicated symbol vectors for 
the kth user following p(x k ) as x k, ° and x k,a = (x k,a , . . . , x k ^ k ) T for a = 1, . . . , u, respectively. 
Due to the independence of the spreading sequences, (129bb yields 



H^ = E{exp [LGP(X)]\H}, 



InE 



n ex p 



Q = 



1 



y 



(3v a 



dy 



x,n 



-iV^ln(7riV Q 



(30a) 
(30b) 



a=0 



where X = {x k ' a ; k — 1, . . . , K, a — 0, . . . , u}, N a = N for a = 1, . . . , u and iV-dimensional 
vector v a is defined as 



K 



V 



(31) 



with i.i.d. M k x M k random matrices {S k ; k = 1,...,K} following p(S k ). Since K and 
L are sufficiently large with their ratio (3 = K/L fixed, due to the central limit theorem, 



,0 T „,uT\T 
, . . . , 



v = (i> v )■* conditioned on X and TL follows approximately the zero-mean circularly 



symmetric complex Gaussian distribution with the covariance matrix 

1 K 

Q = E [Sw k {w k ) H + (1 - 5)W k {W k ) H ] , (32) 
^ k=i 

where w k = [(H k x k >°) T ■ ■ ■ (H k x k > u ) T ] T and W k = [(W k '°) T ■ ■ ■ ( W k ' u ) T ] T with W k > a = 
(h k x k,a ■ ■ ■ h k Mk x k M k ). Evaluating the Gaussian integration in (|30b|) , we obtain 

i_l nS H = i- InE f exp \Kf3~ x G { - u) {Q)\ Til + OiR- 1 ), 

= -lndet(J+SQ)-iVMln(7riV )-iVln(l + ^M) , 



(33a) 
(33b) 
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where £ is given by 



g 

iV + wiV 



Wo 



■ N ■ 



(34) 



-e u (l + 

The expectation with respect to X in (I33al) is evaluated as the expectation with respect to Q 
because (|33bl) depends on X only through Q. Since Q is the empirical mean of independent 
random variables conditioned on 7i, the probability density function of Q conditioned on 7i 
satisfies the large deviation principle 



^\npP(Q\n) = -I^(Q) + o(K), 



where the rate function is given by 



sup 
s 



A' 



Tr(QQ)- lim ^M^iQ) 



(35) 



(36) 



with the moment generating function of the symbols of the A;th user M ( k\Q) defined as 

Mt\Q) =E{e Afc( « ) |/f fc }, A fc = <5Tr (Qw k (w k ) H ) + (1 - S)Tr (QW k (W k ) H ) • (3V) 
Evaluating the expectation in (133al) with the saddle point method, we have 



lim — lnS (u) 



sup 



/3 -1 G? (u) (fi) - 



(38) 



Setting the derivatives of (1361) and ((381) with respect to Q and Q, respectively, to zero, we obtain 
the following equations, which give extrema of (l36l) and (l38l) : 



1 A 1 



Q s = lim — V- 



E { [<5™ fc (™ fc )" + (1 - 5) W fc (W 



,A fc (S s ) 



Substituting (|39b| ) into the derivative of (1381) with respect to «, we can evaluate (|29a|) as 



lim 



,9/7(«) 



<9u 



(39a) 
(39b) 

(40) 



We have to solve (|39a|) and (139b|) analytically in order to evaluate (|40l) . In what follows, we 
assume that the replica symmetry holdj^, i.e., Q s and Q s are invariant under the exchange of 



It should be noted that there exist cases in which the replica symmetry is not valid. See [20] for a discussion of the validity 
in the context of DS-CDMA. 
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non-zero replica indexes. Then, Q s and Q in the limit u — > can be written as 

( Q° e T u ®M \ 

K e u ® M H I u ® (Q 1 -Q) + e u e T a ® Q J ' 



[e u <g> M H J u ® (Q 1 - Q) + e u el <g> Q / 



(41a) 



(41b) 



with N x N matrices M, M and N x N Hermitian matrices Q°, Q°, Q 1 , Q 1 , Q, and Q. 



Comparing both sides of (I39bl) . we obtain in the limit u — > 

Q° = 0, M = k\ Q l = Q-M, Q = R 1 Rk\ 
where and R are respectively given by 

R = N Q I N + 0(Q° — M — M H + Q), 

R = N q In + P(Q 1 -Q). 



(42) 

(43a) 
(43b) 



Next, We solve (|39a|) . We describe only the evaluation of the moment generating function (1371) 
because each term of (I39al) is evaluated in the same manner. It is straightforward to prove that 
R is positive definite. Then, one can take a square root of R such that R = \/R{\fR) H . 
Substituting (|42l) into d37l) . we obtain 

2 



M U) (Q S ) 



E jexp 



o=0 



k^k,^H R -l H k x k,a 



M k 



m=l 



+(i - *) £ ( IK" - Efe^)^ 1 ^ 



Q = 



// 



(44) 



where R = R, R a — R for a — 1, . . . , u and 6 ' and b m are given by 



6 fc = (VS) _1 H*x*' + (VR) H R 1 £ if 



k k,ct 



fe fe,a 
L m Jj m ' 



(45a) 



(45b) 



Of=l 



Substituting two transforms that are similar to the Hubbard-Stratonovich transform, as follows: 

e &\b k \\ 2 = f 1 c 6{-(y k ) H R-iy k +2Rc((b k )»(^/R)- 1 y k )} dy k 

J ir N det(5~ 1 R) 

_(l-5)||fa^|| 2 



J 7r N det[(l-5)-iR] Vm) 1 ; 
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into (1441) . we have 

E xk [q{y\{vl}\x\H k -R)] 



g(y\{w*,}|0,JT*;Jl) 



m=l 



where the function g(2/ fc , {j/^} |tc fc , i3" fc ; i?) is given by 



m=l 



(47) 



q(y k , {y k m }\x k , H k , R) = q(y k \x k , H k , S^R) [] p(l£ja&, h k m , (1 - S^R), (48) 



q(y k \x k ,H k ;R) 



tt^ det i? 
1 



exp 



exp 



-(y k - H k x k ) H R- 1 (y k - H k x k ) 
-(v k - h k r k ) H R' 1 (v k - h k r k 



(49a) 
(49b) 



tt n det R 

Evaluating (|39ab in the same manner and substituting the results into (143 al) and (I43bl) . we 
obtain the following fixed-point equations: 



A 



R=N I N + {3 \im 



k=l 
K 



R = N I N + (3\im - J2 

/woo K k=1 



8H k S k ^ lMO {H k ) H + (1 - 6) £ S&EifrmCO* 

m=l 

^v&W^T + (i - *) £ vg^/^)* 



m=l 



(50a) 
(50b) 



with £mimo' ^simo Vmimc and ^simo defined respectively as 



c MIMO — ^ 



C SIMO ~~ ^ 



(x k -(x k ) s ) (x k -(x k ) s ) H 



11 



h 



V 



k,S 

MIMO 



E 



(x k - {x k ) h ) (x k - (x k % 







r 


n 



K SIMO ~~ ^ 



f k - (f k ) 



(51a) 
(51b) 
(51c) 
(5 Id) 



where the expectations are taken with respect to q(y , {y^ n }\x k , H ; R)p(x k ) and (x } s is given 



by 





x k q(y k ,{y k m }\x k ,H k -,R) 




q{y k 1 {y k m }\x k 1 H k ] R)_ 





(52) 



Since ([52]) is reduced to dial) and (190) for 5 — > and 5 — ► 1, respectively, (I50al) and (I50bl) yield 
(I16al) and (I16bl) . and (I17al) and (I17bl) for 5 ^ and 5 — ► 1, respectively. 
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Differentiating the rate function (1361 ) with respect to u, we obtain 
lim — — 

u^O OU 



K 



S-) = Jta ¥ EC,'ln2- 75 lV 



fc=l 



0' 



• JV 



where C s fc is given by 



iVo + iVo) R 1 + N R RR 1 



Ah- 



(53) 



C* = g(y fe , {y k m }\x\ H k - R) log - ^^#^^1 ^ II ^ 



E~fc 



m=l 



On the other hand, (|33bb yields 

G (m) (Q s ) = — (it — 1) In det R — hi det(Ji + uR) — uN In ic. 

Differentiating (1551 ) with respect to u, we obtain 

dG (u) . , ~ m 



lim 



In det — Ti (RR ) - Nlrnr. 



From (1531) and (l56l) . the free energy (l40l) is evaluated as 



/-^ = lim 1 X; + iVlog(7riV e) + F(Jl, 
in 2 x^oo a ^ 



(54) 



(55) 



(56) 



(57) 



where F(R, R) is given by (|20l) . In particular, ([57]) is reduced to (|18ab and (|18bl ) for 5 — >■ 
and 5 — > 1, respectively. In the case in which there exist multiple solutions of (I50al) and (I50bl) . 
one should choose the solution that yields the supremum of ((381) . which minimizes the free 
energy (l57l) . 



Appendix B 
Derivation of Lemma CD 

With mutually disjoint subsets A$ and A® of .4 = {l,...,u} satisfying \A$\ = j$ and 
| AW | = j'W, and with nonnegative integers and iW, we define a scalar function f k as 



A4 



(i) 



n Re( 



n m 



m=l | J>) p/ «W 

Furthermore, with a real parameter cj, we define a quantity similar to the free energy as 

1 i„ 5W/, .\ 





T = lim ■ 




K,L— >oo 


) is given by 




S (u) (cj) = Ejexp 


w E /*(*) 




keKp 



Y[p^ = y\x a ,S,7i;N ) 



Q=l 



(58) 



(59) 



(60) 
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Differentiating (|59l ) with respect to uj, we obtain 



hm — — 



lim lim - Y.^\fk{X)X\p^ = y\x a ,S,n ] N,) 



o=l 



W ■ (61) 



Substituting the Bayes formula 



p(y*\x a ,S,H;N ) 



p(x a \^,S,7i;N )E g p$\x,S,H;N ( 



p(x a ) 



into (|6"TI). we obtain 



hm — — 

u^O <juJ 



1 



lim - VE 



w=0 



K,L^oo K 



ke/c v 



m=l 



II \ [Re(x^)]^ ) [Im(^)]^(Re(^))^ ) (Im(x^)}^ ) 



(62) 
(63) 



where we have assumed that the limit with respect to u and the many-user limit can be 
interchanged. 

Next, we evaluate (l59l) . We obtain the following expression corresponding to (1381) : 



^=sup \P' 1 G {u) {Q) - I (u) (Q; 



2 



where the extended rate function I^ U \Q; uj) is given by 



jW(Q;o;) = sup 
S 



Tr(QQ)- lim 1 ( V lnA^CS) + In A4 (u) (G; 



uj 



(64) 



(65) 



with the extended moment generating function of the symbols defined as 



M [n] (Q:^) = E \ exp 
Differentiating T with respect to uj, we obtain 



£(^ fc (*)+A fc (<2)) 



(66) 



hm — — 

u^O (juj 



uj=0 



lim-— (Q s ;uj) 



(67) 



uj=0 



where Q s satisfies (l39al) and (I39bl) . 

Assuming the replica symmetry, we can evaluate ([67]) analytically. The derivative of the 
extended moment generating function M.^(Q. \uj) with respect to uj is given by 



duj 



= X) y E »* 

u;=0 fcg/Cp 



Ait- 



m=l 



n w 



m=l 



X 



M, 



q (y\{y* m }\0,H k ;R) 



dy k J] di4,(68) 



m=l 
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where R and R satisfy (|50a| ) and d50bl> . From d63]), ([65]), ([67]), and ([681), we obtain 



lim , 



EE 



m=l 



II [Re(x^)]^[Im(^)]^(Re(^))^(Im(^))^ 



(i) 



lim 



EE 



pi keJC v 



II [^(^)] i -[Im(x^)]^ ) (Re(^)r (lm(x 



m=l 



// 



• (69) 



Acknowledgment 

TT acknowledges support through Grant-in- Aid for Scientific Research on Priority Areas (No. 
18079010) from MEXT, Japan. 



References 

[1] S. Glisic, Advanced Wireless Communications 4G Technologies. John Wiley & Sons Inc, 2004. 

[2] H. Bolcskei, D. Gesbert, and A. J. Paulraj, "On the capacity of OFDM-based spatial multiplexing systems," IEEE Trans. 

Commun., vol. 50, pp. 225-234, Feb. 2002. 
[3] S. Visuri and H. Bolcskei, "Multiple-access strategies for frequency-selective MIMO channels," IEEE Trans. Inf. Theory, 

vol. 52, pp. 3980-3993, Sep. 2006. 
[4] H. Jafarkhani, Space-Time-Coding Theory and Practice. Cambridge, 2005, ch. 4. 

[5] R. G. Gallager, "An inequality on the capacity region of multiaccess multipath channels," in Communications and 
Cryptography: Two Sides of One Tapestry, R. E. Blahut, D. J. Costello, U. Maurer, and T. Mittelholzer, Eds. New 
York: Kluwer, 1994, pp. 129-139. 

[6] S. Verdu and S. Shamai, "Spectral efficiency of CDMA with random spreading," IEEE Trans. Inf. Theory, vol. 45, pp. 
622-640, Mar. 1999. 

[7] D. N. C. Tse and S. V. Hanly, "Linear multiuser receivers: effective interference, effective bandwidth and user capacity," 

IEEE Trans. Inf. Theory, vol. 45, pp. 641-657, Mar. 1999. 
[8] T. Tanaka, "A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors," IEEE Trans. Inf. 

Theory, vol. 48, pp. 2888-2910, Nov. 2002. 
[9] D. Guo and S. Verdu, "Randomly spread CDMA: Asymptotics via statistical physics," IEEE Trans. Inf. Theory, vol. 51, 

pp. 1983-2010, Jun. 2005. 

[10] Y. Kabashima, "A CDMA multiuser detection algorithm on the basis of belief propagation," J. Phys. A: Math. Gen., vol. 36, 
pp. 11 111-11 121, 2003. 

[11] T. Ikehara and T. Tanaka, "Decoupling principle in belief-propagation-based CDMA multiuser detection algorithm," to be 

published in Proc. 2007 IEEE Int. Symp. Inf. Theory, Nice, France, Jun. 2007. 
[12] A. Mantravadi, V. V. Veeravalli, and H. Viswanathan, "Spectral efficiency of MIMO multiaccess systems with single-user 

decoding," IEEE J. Sel. Areas Commun., vol. 21, pp. 382-394, Apr. 2003. 
[13] M. Juntti, J. L. M. Vehkapera, Z. Li, D. Tujkovic, S. Tsumura, and S. Hara, "MIMO MC-CDMA communications for 

future cellular systems," IEEE Commun. Mag., vol. 43, pp. 118-124, Feb. 2005. 
[14] Z. Ni and D. Li, "Spectral efficiency of distributed MIMO code division multiple access systems over multipath fading 

channels," Wirel. Commun. Mob. Comput., vol. 5, pp. 35^-3, 2005. 



February 1, 2008 



DRAFT 



21 



[15] A. Nordio and G. Taricco, "Linear receivers for the multiple-input multiple-output multiple-access channel," IEEE Trans. 

Commun., vol. 54, pp. 1446-1456, Aug. 2006. 
[16] D. N. C. Tse and P. Viswanath, Fundamentals of Wireless Communication. Cambridge University Press, 2005, ch. 8. 
[17] S. V. Hanly and D. N. C. Tse, "Resource pooling and effective bandwidths in CDMA networks with multiuser receivers 

and spatial diversity," IEEE Trans. Inform. Theory, vol. 47, pp. 1328-1351, May 2001. 
[18] D. Guo, "Performance of multicarrier CDMA in frequency-selective fading via statistical physics," IEEE Trans. Inf. Theory, 

vol. 52, pp. 1765-1774, Apr. 2006. 
[19] A. M. Tulino and S. Verdii, Random Matrix Theory and Wireless Communications. Now Publishers Inc., 2004, ch. 2. 
[20] M. Yoshida, T. Uezu, T. Tanaka, and M. Okada, "Statistical mechanical study of code-division multiple-access multiuser 

detectors," J. Phys. Soc. Jpn., vol. 76, pp. 054 003-1-10, 2007. 



February 1, 2008 



DRAFT 



22 



spreading sequence 



modulator 



k 
*1 



antenna 1 



j 



encoder 



spreading sequence 



modulator 



k 
x Mi 



antenna M 



4> 



T 



Fig. 1. Transmitter structure with the STS scheme. 
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Fig. 2. Transmitter structure with the TS scheme. 
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w 0.5 1 1.5 2 2.5 3 

P 

Fig. 3. Spectral efficiency per transmit antenna of the MIMO DS-CDMA channel versus (3 in the case of the Gaussian data 
modulation. The solid lines are the spectral efficiencies per transmit antenna in the case of the STS scheme. The dashed lines 
represent the spectral efficiencies per transmit antenna in the case of the TS scheme. The dashed lines overlap for M = N = 
2, . . . , oo. P/N = 10 dB. 
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Fig. 4. Spectral efficiency per transmit antenna of the MIMO DS-CDMA channel with the QPSK data modulation scheme 
versus f3 in the case of the STS scheme. The dashed line is the maximum spectral efficiency per transmit antenna of the MIMO 
DS-CDMA channel with the Gaussian data modulation scheme and the STS scheme for M = N — oo. P/No = 10 dB. 
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